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ABSTRACT 


Mathematical  models  and  a  computer  simulation  program 
written  in  APL  are  proposed  for  studying  ways  of  dealing 
with  mis-calibration.   Methodology  for  assessing  the  system 
effectiveness  and  an  approach  for  optimizing  the  effective- 
ness of  a  calibration  program  are  examined.   The  applica- 
tion of  the  theory  is  discussed  and  the  results  of  the 
simulation  program  are  presented. 
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I.   INTRODUCTION 

The  effectiveness  of  many  systems  depends  upon  the 
degree  of  the  calibration  of  their  subsystems.   For  example, 
a  ship  with  navigational  equipment  that  is  out  of  calibration 
may  not  be  able  to  locate  its  destination,  or,  in  the  case 
of  a  Navy  ship,  locate  an  adversary.   If  the  Navy  ship's 
weapon  system  is  also  out  of  calibration  the  difficulties 
are  compounded.   An  analogous  problem  arises  in  connection 
with  engine  de-tuning,  when  fuel  consumption  will  likely 
increase  and  performance  decrease,  and  with  drift  of  communi- 
cation systems.   The  detrimental  effect  of  mis-calibration 
is  well  recognized:   Navy  ships  and  other  systems  are  taken 
to  ranges  or  other  facilities  for  testing  and  re-calibration. 

The  purpose  of  this  thesis  is  to  set  up  mathematical 
models  for  studying  ways  of  dealing  with  mis-calibration.   If 
the  various  aspects  of  the  problem  can  be  assembled,  some 
guidance  is  then  available  for  dealing  with  it  effectively. 
Although  various  realistic  elements  of  the  problem  can  be 
introduced,  the  fundamental  issue  is  this:   given  that 
important  subsystems  depart  from  calibration  and  effective- 
ness as  time  passes,  it  is  desirable  to  determine  a  schedule 
for  re-calibration  that  (nearly)  optimizes  system  operational 
effectiveness.   Frequent  calibration  of  important  systems 
would  be  highly  desirable  if  this  were  a  cost-free  operation, 


but  in  reality  the  operational  cost  of  calibration  is  time — 
time  during  which  the  system  is  unavailable  for,  or  so 
degraded  as  to  be  incapable  of  adequately  performing,  its 
operational  purpose.   Figure  1  is  an  idealized  graph  of 
operational  effectiveness  against  time.   The  periods  of 
duration  C  denote  those  periods  during  which  the  system  has 
zero  effectiveness  because  it  is  undergoing  calibration  and 
hence  is  out  of  the  operational  area;  the  periods  of  duration 
T  represent  those  periods  during  which  the  system  is  opera- 
tional, but  of  diminishing  effectiveness. 


Figure  1.1.   Idealized  Graph  of  Operational  Effectiveness 
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The  graph  suggests  that  if  effectiveness  drops  with  time 
there  will  be  an  optimal  value  for  T,  a  "best"  period,  T*, 
at  which  to  calibrate.   We  now  show  how  such  a  period  may 
be  determined.   Later,  more  complex  and  realistic  models 
and  simulation  results  will  be  introduced. 
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II.   MATHEMATICAL  MODELS 

For  a  mathematical  treatment  let  e(t)  be  the  effective- 
ness, e.g.,  the  probability  of  successful  mission  completion, 
at  time  t  after  the  calibrated  system  returns  to  service. 
Let  C  be  the  time  required  for  calibration,  and  T  the  duty 
or  on-station  time.   Then  the  average  effectiveness  over  a 
cycle  of  length  T+C,  and  hence  in  the  long  run,  is 


T 
/   e(t)dt  +  0 

e(T)       =      ° —^ ;  (2.1) 


the  term  0  represents  and  emphasizes  the  total  lack  of 
effectiveness  during  the  calibration  period.   In  order  to 
maximize  e(T)  it  is  useful  to  study  the  derivative 

T 

(T+C) e(T)  -  /   e(t) dt 

de(T)   _   _0 (7    0, 

dT  2  {     '  ; 

a  (T  +  C) 


as  it  depends  on  T:   if  de(T)/dT  =  0  for  T*  >  0  then  T*  is 
a  candidate  for  a  time  between  the  end  of  one  calibration 
and  the  beginning  of  the  next.   Equivalently ,  (2.2)  asks  if 
there  is  a  positive  solution  T* ,  of 


1     T 
e(T)   =   ^   /   e(t)dt  (2.3) 

0 
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for  fixed  positive  C.   The  fact  that  such  a  solution  always 
exists,  and  that  it  defines  an  optimum  can  be  established 
from  the  usual  second  derivative  criterion.   Since  the 
optimal  T  satisfies  (2.3),  it  turns  out  that  at  the  optimum 
the  average  effectiveness  over  an  entire  cycle  equals  the 
effectiveness  at  the  time  the  active  part  of  the  cycle 
ends;  or  symbolically 

e(T*)   =   e(T*)  (2.4) 

where  the  over-bar  signifies  the  time  average  of  effective- 
ness over  T*  +  C. 

To  build  understanding,  examine  some  extremely  simple 
specific  models. 

A.   LINEAR  EFFECTIVENESS  LOSS 
Put 


<    1  -  at,    0  <_   t  <_   a~ 
e(t)   =  (2.5) 

'  0  a"1  <  t  . 


so  that  the  downward-sloping  parts  of  the  graph  of  Figure 
1.1  are  strictly  linear.   Then  (2.3),  the  equation  for 
optimal  T  =  T*,  is 


1  -  aT   =   ^  (T  -  |  T2)  ,   0  <  T  <  a  1    ;      (2.6) 
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It  is  clear  that  no  value  of  T  >  a    can  be  optimum.   The 
equation  (2.6)  simplifies  to  the  quadratic 


aT2  +  2aCT  -  2C   =   0  (2.7) 


with  a  single  positive  solution 


=   -C  +  VC2 


C  +  vc   +  2C/a  (2.8) 


at  which    the   optimum  value   of    effectiveness 


T* 
/         e(t)dt 

e(T*)       = T^    -  =      1"-    aT*      =      1    +    aC    -   v/a2c2  +  2aC 


=       (1+aC)    -\/(l+aC)2-l  (2.9) 

It  is  interesting  that  the  solution  depends  only  upon  the 
parameter  aC  the  product  of  calibration  drift  rate,  a,  and 
the  length  of  the  re-calibration  period,  C.   For  instance, 
if  aC  -»■  0  then  effectiveness  approaches  unity  if  either  the 
rate  of  calibration  degradation,  a,  approaches  zero,  or  the 
calibration  time,  C,  approaches  zero,  or  both,  or  one 
approaches  zero  more  rapidly  than  the  other  gets  large. 
Alternatively,  this  shows  that  equal-effectiveness  or  a-C 
tradeoff  curves  are  simple  hyperbolas  in  the  (a,C)  plane. 
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The  above  model  is  rather  crude,  but  is  easy  to  under- 
stand.  There  follows  another  model  that  is  more  qualita- 
tively appealing. 

B.   LINEAR  DEGRADATION  WITH  DIFFUSE  DAMAGE 

Consider  next  a  more  specific  model  for  effectiveness, 
one  that  relates  to  damage  inflicted  on  a  target  after  time 
t  has  elapsed,  and  the  system  has  developed  an  (unsuspected) 
bias  of  magnitude  at.   At  that  time  the  x-y  error  made  in 
locating  a  target  is  assumed  to  be  given  by  the  joint 
Gauss/normal  density 


f(X,y;t)         =       -Xj   exp[-  |1X'a2t>2   -|     (r-a2t>2]  (2.10) 

2tto  a  a 


If  a  cookie-cutter  damage  function  with  radius  R  is  in 

2     2     2 
effect  (no  damage  if  x   +  y   >  R  ,  destruction  if 

2     2 
x   +  y   <  R)  then 


(t)   =   //  f(x,y;t)dxdy  . 

2     2     2 
(x   +  y   <  R  ) 


However,  this  is  difficult  to  work  with,  and  even  overly 
simplistic.   Instead,  suppose  that  a  von  Neumann-Gauss 
diffuse  damage  function  can  be  used;  i.e.,  that  the  proba- 
bility of  critical  damage  to  a  target  located  at  (0,0)  by  a 

2 
weapon  with  impact  point  (x,y)  is  equal  to  6 (x,y)  =  exp(-a(x 

+  y2) ) .   Then 
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(t)       =      //    6 (x,y) f (x,y;t)dxdy 


oo  oo 

2         /  /      exp[-a(x    +y    ) ] f (x,y ; t) dxdy 

2ttg      -°°         -°° 


00  2  2 

(— —   j      exp[-  | (at~*}  ]exp[-ax2]dx)        (2.11) 

/2tto  -°°  a 


by  virtue  of  the  symmetry  assumed;  almost  free  of  charge  we 
can  consider  asymmetrical  damage  functions,  but  the  oppor- 
tunity is  declined.   The  above  integral  is  evaluated  at  sight 
it  is  seen  to  be  essentially  the  convolution  of  two  normal 
densities.   After  squaring,  as  demanded  by  (2.11), 


2 
~  /  j.  \         l/2a        r      (at)    -,  ,  -  ,  „ . 

e(t)   =   — s— '- exp  [-  — ^ ]         (2.12) 

(o  +l/2a)        (az  +l/2a) 


Instead  of  dropping  off  linearly,  as  in  the  previous  case, 
e(t)  first  diminishes  rather  slowly,  later  falling  quite 

rapidly  (exponentially  fast)  towards  zero:   by  the  time 

/~2 

at  =  vo   +  l/2ct,  effectiveness  is  just  below  40%  of  its 


n. 

maximum,  while  if  at  =  0.5  vo   +  l/2a,  effectiveness  is  about 


f~2 

78%  of  the  maximum;  finally  if  at  =  0.25  va   +  l/2a,  effec- 
tiveness is  94%  of  the  maximum.   Note  that  the  maximum 

2-1  2 

effectiveness  is  (1  +  2ao  )    <_   1;  if  either  a   or  a  become 

large,  meaning  that  if  either  weapon  effectiveness  falls  off 

rapidly  with  miss  distance  (a  large)  or  the  ultimate  weapon 
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2 
delivery  variance  is  great  (a   large),  then  even  maximum 

effectiveness  is  low. 

In  order  to  solve  for  the  optimum  T*  write 


T 
(T+C)exp(-(aT) 2/(o2+l/2a) )   =    /  exp (- (at) 2/ (a2+l/2a) ) dt  . 

0 

(2.13) 


Change  the  variables  to  the  dimensionless  version 


t   =   (aT)/(a2  +  l/2c01/2  ;   y   =   (aC)  /  (a2  +  l/2a)  1/2  ,   (2.14) 


so  one  can  solve  the  following  dimensionless  equation  once 
and  for  all  for  t*: 


2  ~*~  2 

(T+y)exp(-x  )   =    /   exp(-z  )dz  ;  (2.15) 


the  positive  value  of  t,  namely  x*,  that  satisfies  this 
equation  may  be  located  by  Newton- Raphson ,  or  even  graphically 
one  can  plot ,  for  given  y , 


2 
L(t)   =   (x+y)exp(-T 


and 


T        2 
R(t)   =    /   exp(-z  )dz 

0 


on  the  same  piece  of  paper,  vs.  t. 
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The  arbitrary  selected  y  values  and  the  corresponding 
t*  values  from  the  computer  program  which  solves  the  dimen- 
sionless  equation  (2.15)  are  shown  in  Table  1. 

TABLE  1 

Gamma  and  Optimum  Tau  Values 

GAMMA  TAU 

0.001  0.025 

0.002  0.115 

0.003  0.144 

0.004  0.165 

0.005  0.181 

0.006  0.195 

0.007  0.207 

0.008  0.218 

0.009  0.227 

0.01  0.236 

0.02  0.302 

0.03  0.346 

0.04  0.381 

0.05  0.410 

0.06  0.434 

0.07  0.456 

0.08  0.476 

0.09  0.494 

0.1  0.511 

0.2  0.632 

0.3  0.713 

0.4  0.775 

0.5  0.825 

0.6  0.867 

0.7  0.904 

0.8  0.937 

0.9  0.966 

1.0  0.992 
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In  order  to  redefine  t  and  y  i-n  (2.14)  and  the  effective- 
ness formula  (2.12)  in  more  meaningful  form,  again  change 
variables  to 


v   =   1/2 a  ;    p   =    9  1/2a   ;    k   =   a/a        (2.16) 

a  +l/2a 


where  v  and  p  might  be  called  vulnerability  and  probability 
of  success  respectively,  and  k  is  constant.   In  the  simula- 
tion chapter  connections  are  developed  between  v  and  the 
radius  of  a  (roughly)  equivalent  cookie-cutter  damage 
function.   So  one  can  write 


T   =   k  /l-£  T  ;     y   =   k  /1-p  C  .  (2.17) 

We  focus  attention  on  the  representation  (2.12)  in  what 
follows,  mainly  for  analytical  and  computational 
convenience . 


e(t)   =   p  exp  [-(kt)2(l-p)J  (2.18) 


Thus,  the  preceding  expression  at  optimum  leads  to  the 
relationship 

e(T*)   =   p  exp  (-T*) 2  (2.19) 

and  consequently,  the  optimal  proportion  of  on-station  time 
can  be  obtained  as  follows: 

19 


c 


—  ,  (2.20) 

k  /1-p 


so  the  proportion  of  on-station  time  is,  under  optimum 
conditions , 


T*  +C      t*  +  y 


2.21) 


Since  optimum  t  values  are  available  from  Table  1,  one  can 
very  easily  calculate  the  effectiveness  given  some  constant 
variance  and  v  or  only  p.   Some  of  the  results  are  tabulated 
in  Table  2  as  an  example. 

Additionally,  plots  of  tau  vs.  gamma  and  effectiveness 
vs.  tau  are  presented  in  Appendix  A.   It  is  observed  that  the 
effectiveness  decreases  as  the  variance  increases  while  v 
is  held  constant.   Effectiveness  vs.  tau  plots  illustrate 
the  behavior  of  the  effectiveness  representation  in  a  more 
understandable  fashion  than  does  the  formula  itself. 

Example :   Suppose  a  =  1.5  yds/month,  C  =  0.5  month, 

2  2 

a   =  20  (yds)   and  p  =  0.9  are  given.   First  find  y    from 

(2.17)  as  0.053,  then  look  up  corresponding  t*  value  from 

Table  1  which  is  0.417.   Later,  from  (2.20)  T*  is  3.93  months 

and  from  (2.21)  the  proportion  of  on-station  time  is  88.7%, 

and  from  (2.19)  or  Table  1  an  average  effectiveness  of 

75.6%  can  be  obtained. 
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TABLE  2 
Effectiveness  for  Constant  Variance  and  v 

EFFECTIVENESS  EFFECTIVENESS 


(a2  = 10;    v 

=  200) 

(a2  =  20;    v  = 200) 

0.952 

0.908 

0.940 

.     0.897 

0.933 

0.890 

0.927 

0.885 

0.922 

0.880 

0.917 

0.875 

0.912 

0.871 

0.908 

0.867 

0.904 

0.863 

0.901 

0.860 

0.869 

0.830 

0.845 

0.806 

0.824 

0.786 

0.805 

0.768 

0.789 

0.753 

0.773 

0.738 

0.759 

0.725 

0.746 

0.712 

0.733 

0.700 

0.639 

0.610 

0.573 

0.547 

0.522 

0.499 

0.482 

0.460 

0.449 

0.429 

0.421 

0.401 

0.396 

0.378 

0.374 

0.357 

0.356 

0.340 
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C.   LINEAR  DEGRADATION  WITH  DIFFUSE  DAMAGE  USING  RANDOM  DRIFT 

For  an  alternative  model,  that  incorporates  the  possibly 
different  drift  rates  of  different  individual  ships  or 
systems,  suppose  that  the  drift,  a,  is  a  random  variable 
with  an  appropriate  distribution  function  instead  of  a 
constant  as  in  (2.12),  namely,  the  effectiveness  conditional 
on  a  is 

2 
1  n  (at) 

e(t;a)   =   j^-^ exp  [ ^ ]  .     (2.22) 

(o  +  l/2a)        (a  +l/2a) 

Then,  the  expected  average  or  unconditional  effectiveness 
over  a  cycle  of  length  T+C ,  in  the  long  run,  becomes 


T 
/   E[e(t;a)]dt 

E[e(T;a)]   =   - ^-^ (2.23) 


in  order  to  be  specific  (but  not  necessarily  realistic)  and 

also  so  that  explicit  mathematical  results  are  obtained,  let 

'  2 

a   have  a  gamma  distribution  function  with  parameters  A  and 


6, 


9             ,  -Ax  , ,  , 3-1 
fa/(x;A,B)   =   — fjfy1 A,B  >  0  ,        (2.24) 


2 
and  put  for  fixed  a  ,  i.e.,  the  square  of  the  drift  rate 


away  from  calibration, 
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4 

E(a2)   =   a2   =   f-  ;   so   Var(a2)   =  JL  =   *         (2.25; 

X  A2      0 


now  use  (2.22)  and  (2.23)  to  obtain 


oo  2 

E[e(t;a)]   =   -^^ /exp[-x(-~ ^ )  ]  f  a2  (x;  A  ,  6  )  d: 

(a  +l/2a)  0         a  +  l/2a 


after  substituting  the  gamma  density  function  it  is  easily 
seen  that  the  result  of  the  integration  yields 


9  1/2a  -(-       -5-  \ 

(a2+l/2a)  \A       t2 

a  +l/2a 


or  equivalently ,  in  view  of  (2.25) 


— T^ / ± T~ 

(az  +l/2a)  \1  + Ut)z 

(a2  + l/2a)6 


Various  analytical  properties  of  the  previously'  described 
model  will  now  be  recorded.   These  provide  useful  insights 
into  the  behavior  of  the  effectiveness  at  time  t. 
1.   If  6  ■>  0°,  (2.27)  becomes 


E[e(t;a)]   =    ?1/2a —  exp[-(at)2]  (2.28) 

a     +l/2a 
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which  reflects  the  fact  that  if  3  increases  the  variance  of 
a  in  the  distribution  of  drift  rate  decreases  towards  zero, 
and  the  situation  reduces  to  that  of  Model  B. 
2.   If  3  ■»■  1,  then 


E[e(t;a)]   =   5 ^^ =-  ,  (2.29) 

(a  +l/2a  +  (at)') 


which  is  larger  than  the  effectiveness  in  the  equal-drift 
case . 

In  order  to  solve  for  the  optimum  T*  for  the  general 
case  write 


T 
T+C  r  1 

/ 5 dt  .     (2.30) 


(i+ ^nl >3       0     d+    (at)2     -) 

(a2  +l/2a)B  (a2  +l/2a)6 


Change    the   variables    to 


x      =       (aT)/(a2  +l/2a)1/2    ;       y      =       (aC) / (a2  + l/2a) 1/2       (2.31) 


so  one  can  solve  the  dimensionless  equation 


t   3      0       z   6 

<i+V»  «l+V 


the  positive  value  of  x,  namely  r*,  that  satisfies  this 
equation  for  any  constant  6  may  be  found  by  a  computer 
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program.   In  fact,  one  may  get  the  solution  for  the  special 
case  3  =  1  by  making  use  of  arctg  integration  for  the  right- 
hand  side: 


y   =   (arctg  t)(1  +  t2)  -  t  .  (2.33 


In  general,  the  right-hand  integral  can  be  transformed 
to  the  integral  of  a  Student's  t  density,  and  the  t-tables 
found  in  most  statistics  books  can  be  used  to  evaluate  it. 

Again,  the  arbitrary  selected  y  values  and  the  correspond- 
ing t*  values  for  $  =  1  are  presented  in  Table  3. 

At  this  point,  it  is  very  easy  to  calculate  the  effec- 
tiveness given  some  constant  variance  and  v  or  only  p  from 
(2.19) .   Some  of  the  results  are  listed  in  Table  4  as  an 
example . 

In  addition  to  the  tables,  plots  of  tau  vs.  gamma  and 
effectiveness  vs.  tau  are  presented  in  Appendix  B.   As  in 
the  previous  case,  effectiveness  decreases  as  the  variance 
increases  when  v  is  held  constant. 
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TABLE  3 
Gamma  and  Optimum  Tau  Values  (3  =  1) 

GAMMA  TAU 

0.001  0.025 

0.002  0.115 

0.003  0.145 

0.004  0.166 

0.005  0.182 

0.006  0.196 

0.007  0.209 

0.008  0.220 

0.009  0.230 

0.01  0.239 

0.02  0.307 

0.03  0.355 

0.04  0.392 

0.05  0.424 

0.06  0,451 

0.07  0.476 

0.08  0.499 

0.09  0.520 

0.1  0.539 

0.2  0.687 

0.3  0.793 

0.4  0.879 

0.5  0.952 

0.6  1.018 

0.7  1.077 

0.8  1.131 

0.9  1.181 

1.0  1.228 
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TABLE  4 
Effectiveness  for  Constant  Variance  and  v  (3=1) 

EFFECTIVENESS  EFFECTIVENESS 


(a2  =  20;    v  = 150) 

(a2  =30;    v  =  150) 

0.882 

0.833 

0.871 

0.822 

0.864 

0.816 

0.859 

0.811 

0.854 

0.807 

0.850 

0.802 

0.845 

0.798 

0.842 

0.795 

0.838 

0.791 

0.  835 

0.788 

0.806 

0.761 

0.784 

0.740 

0.765 

0.722 

0.748 

0.706 

0.733 

0.692 

0.719 

0.679 

0.706 

0.667 

0.694 

0.656 

0.684 

0.646 

0.599 

0.566 

0.542 

0.512 

0.498 

0.470 

0.463 

0.437 

0.433 

0.409 

0.408 

0.386 

0.387 

0.366 

0.368 

0.348 

0.352 

0.332 
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III.   TRANSFORMATIONS  AND  SIMULATION 

A.   TRANSFORMATIONS 

Earlier  it  has  been  shown  that  t*  can  be  computed  in 
terms  of  y.   In  order  to  simplify  this  step,  it  would  be 
desirable  to  be  able  to  represent  t *  by  some  simple  formula 
in  terms  of  y.   Following  the  lead  of  statistical  regression 
studies,  it  is  sometimes  possible  to  investigate  the  effects 
produced  by  transformations  of  the  predictor  variables,  or 
by  transformations  of  the  response  variable,  or  by  both. 
Clearly  there  are  many  possible  transformations  of  gamma  and 
tau  values.   Several  different  transformations  of  gamma  and 
tau  could  be  tried  for  the  same  model,  of  course.   The  choice 
of  which  is  sometimes  difficult  to  decide  and  the  choice 
would  often  be  made  on  the  basis  of  previous  knowledge  of 
the  gamma  and  tau  under  study.   The  purpose  of  making  trans- 
formations of  this  type  is  to  be  able  to  use  a  simple 
regression  model  in  the  transformed  tau  and  gamma,  rather 
than  a  more  complicated  one  in  the  original  gamma  and  tau. 
Some  suitable  transformations  of  gamma  or  tau  can  also  be 
found  by  plotting  them  in  various  ways.   First,  In (tau)  vs. 
In (gamma)  has  been  plotted  for  the  linear  degradation  with 
diffuse  damage  case  and  the  linear  degradation  with  diffuse 
damage  using  random  drift  case,  later  various  power  trans- 
formations have  been  applied  to  tau  values  and  simple 
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regression  equations  have  been  derived  in  order  to  obtain 
the  optimum  tau  values  directly  for  arbitrary  selected  gamma 
values  without  having  to  go  to  tables  or  equations  (2.15) 
and  (2.32).   Some  of  the  transformation  plots  are  shown  in 
Appendix  C.   After  obtaining  a  suitable  power  transformation 
of  tau,  one  could  guidely  calculate  the  effectiveness  values 
by  using  predicted  tau  values  from  regression  equation. 
This  attempt  at  simplification  deserves  more  study  before 
it  can  be  said  to  be  truly  satisfactory. 

B.   SIMULATION 

Simulation  is  essentially  a  controlled  statistical 
sampling  technique  (experiment)  which  is  used,  in  conjunction 
with  a  model,  to  obtain  approximate  answers  for  complex 
(probabilistic)  problems  when  analytical  and  numerical 
techniques  are  too  expensive,  or  infeasible. 

The  main  purpose  of  the  simulation  in  this  thesis  is  to 
be  able  to  evaluate  effectiveness  for  other  kinds  of  damage 
functions  or  error  distributions  which  are  difficult  to  work 
with,  as  alternatives  to  a  von  Neumann-Gauss  diffuse  damage 
function.   For  example,  if  a  cookie-cutter  damage  function 
with  radius  R  is  in  effect  then  a  closed  form  solution  of 
the  effectiveness  similar  to  (2.12)  is  not  as  simple.   Unlike 
a  mathematical  solution,  the  answer  one  obtains  from  a 
simulation  is  an  estimate  of  the  effectiveness.   It  is 
absolutely  necessary  to  have  some  idea  of  the  precision  of 
the  effectiveness.   For  this  reason,  the  effectiveness 
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estimated  from  each  simulation  has  error  bounds  of  two  standard 
deviations  for  valid  comparisons.   The  interactive  simulation 
program,  written  in  APL,  is  presented  in  Appendix  D. 

The  scenario  developed  in  this  program  determines  the 
optimal  time  for  a  submarine  to  come  in  to  port  for  instru- 
ment re-calibration.   In  other  words,  simulation  is  being 
used  to  determine  T*  for  a  variety  of  cases  —  ones  in  which 
the  previous  neat  mathematical  theory  of  Chapter  II  cannot 
easily  be  extended.   A  vector  of  possible  times  (in  arbi- 
trary time  units  such  as  days)  at  which  the  submarine  should 
be  brought  back  for  equipment  re-calibration  is  needed.   For 
each  of  these  times  the  program  estimates  the  expected 
effectiveness  of  the  submarine.   The  time  that  corresponds 
to  maximal  effectiveness  is  considered  optimal.   Although  the 
effectiveness  of  the  submarine  changes  continuously  with 
time,  in  the  simulation  the  effectiveness  is  estimated  only 
at  discrete  but  closely-spaced  time  points.   The  more  points 
one  has,  the  smoother  the  effectiveness  curve,  but  the  longer 
the  program  takes  to  run.   In  addition,  the  duration  of  re- 
calibration  of  the  equipment  (C)  and  the  number  of  replica- 
tions of  the  simulation  should  be  entered.   Again,  the 
precision  of  the  estimates  of  the  effectiveness  curve  gets 
better  with  more  replications,  but,  again,  it  takes  longer 
to  run  the  program. 

Effectiveness  is  measured  as  the  probability  of  damaging 
a  target  ship  that  is  1000  distance  units  away  from  the 
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submarine.   The  weapon  is  a  straight-run  classical  torpedo 
with  a  proximity  fuse.   The  submarine  fires  the  torpedo  along 
some  bearing  and  the  torpedo  is  supposed  to  explode  at  the 
point  nearest  to  the  target.   But  the  equipment  to  locate  the 
target  develops  calibration  problems  with  time,  namely 
calibration  drifts  by  a  certain  distance  for  every'  time  unit 
according  to  the  following  specific  alternative  model 
options,  any  one  of  which  may  be  considered  by  the  analyst: 

1.  It  might  get  deterministically  worse  with  time.   So, 
the  expectation  of  drift  becomes  E(at)  =  at;  the  rate  a  must 
be  specified.   This  is  Model  1. 

2.  It  might  get  randomly  worse  with  time.   On  day  T,  the 
drift  is  mismeasured  by  an  amount  T  x  Normal ( 0 , Sigma) . 

Although  the  mean  error  is  zero,  the  variance  of  the  error 

2 
increases  as  sigma  xtime.   Notice  that  the  random  multiplier 

is  constant  in  each  replication  of  the  simulation.   This  is 

Model  2. 

3.  It  might  fluctuate  randomly  with  time.   On  each  day, 
the  drift  is  mismeasured  by  an  additional  drift  error.   This 
error  term  is  random  and  comes  from  a  Normal ( 0 , Sigma)  dis- 
tribution, where  sigma  is  expressed  in  distance  units  and 
represents  the  standard  deviation  of  the  error  distribution. 
Notice  that  the  expected  error  is  always  zero,  although  the 
variance  grows  proportionally  with  time.   In  this  case, 
calibration  can  improve  or  worsen  with  time.   This  is 
Model  3. 
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4.   It  might  exhibit  a  random  drift,  with  magnitude  drawn 
from  a  gamma  distribution.   Thus,  calibration  drift  for  every 
time  unit  becomes  a  gamma  random  variable  with  shape  param- 
eters lambda  and  beta;  the  drift  gets  worse  with  time.   Note 
that  the  program  uses  GAMMACK  APL  library  function  to 
generate  the  incomplete  gamma  random  variable.   This  is  Model 
4.   The  gamma  variability  explains  the  differences  in  drift 
exhibited  by  different  system  copies . 

The  user  may  choose  which  of  the  above  models  best  des- 
cribes his  or  her  situation. 

After  a  straight-run  classical  torpedo  is  aimed  at  a 
point  influenced  by  one  of  the  preceding  calibration  errors, 
it  may  not  explode  at  precisely  the  point  on  that  bearing 
that  is  closest  to  the  target,  i.e.,  the  proximity  fuse  is 
assumed  to  be  not  perfectly  accurate,  as  is  true  in  reality. 
The  error  between  the  closest  point  and  the  explosion  point 
can  come  from  either  normal  distribution  with  variances  in 
the  X  and  Y  direction  or  a  uniform  distribution  with  (-X,X) 
and  (-Y,Y) . 

Finally,  the  target  is  damaged  with  a  probability  calcu- 
lated according  to  one  of  the  following  optional  functions: 

1.  Gauss  diffuse  damage:   Probability  of  critical  damage 

to  a  target  located  at  (0,0)  by  a  weapon  with  impact  point 

2    2 
(x,y)  is  equal  to  5  (x,y)  =  exp(-a(x  +y  )). 

2.  Cookie-cutter:   The  torpedo  will  destroy  the  target 

if  it  is  within  a  certain  radius  R,  and  it  will  do  no  damage 
if  it  is  outside  this  radius. 
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3.   Trapezoidal:   The  trapezoidal  damage  function  has  a 
central,  circular  plateau  of  radius  R,  .   If  the  target  is 
within  R,  distance  units  from  the  exploding  torpedo,  then 
the  target  is  damaged  with  probability  one  as  it  is  in  the 
cookie-cutter.   In  addition,  the  function  has  an  outer 
circular  rim,  of  radius  R~  ,  R-  >  R-,  ,  beyond  which  the  proba- 
bility of  damaging  the  ship  is  zero.   Between  the  two 
radii,  the  damage  probability  goes  down  linearly. 

As  a  result,  the  simulation  program  provides  three  basic 
output  arrays.   EFF  contains  the  estimated  effectiveness  at 
each  time  increment,  delta,  out  to  the  maximum  time.   Again, 
the  effectiveness  is  simply  the  probability  of  the  torpedo 
destroying  the  target.   STDEFF  contains  the  standard  devia- 
tions of  the  estimates  in  EFF.   Lastly,  AVGEFF  contains  the 
long-term  average  effectiveness  of  the  submarine  if  it 
returns  after  the  various  times  following  calibration  delays 
input  at  the  beginning  of  the  program. 

Plots  of  simulation  results  in  Appendix  E  were  obtained 
from  the  general  plot  function  in  GRAFSTAT  which  is  an  APL 
workspace  for  the  interactive  creation  of  scientific-engineering 
graphics,  for  interactive  data  analysis  and  for  the  inter- 
active development  of  APL  graphics  output  routines.   It  runs 
on  both  the  IBM  3277GA  graphics  terminal  and  the  3278/79 
terminal.   Full  color  control  is  available  when  running  on 
the  3279  terminal.   The  simulation  program  is  attached  to 
GRAFSTAT  in  order  not  to  waste  time  in  assessment  of  the 
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results  and  to  be  able  to  make  sensitivity  analyses  easily. 
For  each  run,  two  different  graphs  are  obtained.   One  of  them 
shows  estimated  effectiveness  of  a  submarine  with  error 
bounds  of  two  standard  deviations.   The  other  one  demonstrates 
the  long-term  average  effectiveness  of  a  submarine,  given 
that  it  stays  at  sea  for  a  tour  of  length  T.   Since  there 
is  a  large  number  of  combinations  in  the  program,  only 
limited  numbers  of  results  are  presented  in  this  thesis. 
The  first  six  plots  simply  exhibit  the  sensitivity  of  the 
system  effectiveness  to  the  parameter  alpha  of  the  Gauss- 
diffuse  damage  function;  other  variables  are  held  constant. 
It  is  observed  that  the  optimum  T  gets  smaller  as  the 
parameter  alpha  gets  bigger;  since  a  large  a  corresponds  to 
a  small  effective  damage  region,  a  short  tour  length  is 
necessary  to  keep  effectiveness  high.   In  addition,  some 
interesting  combinations  of  alternatives  are  also  presented 
in  order  to  give  an  idea  about  the  behavior  of  the  other 
parameters.   There  is  not  much  to  say  about  them  since  they 
are  quite  self-explanatory. 

It  is  of  interest  to  check  out  the  possible  relationship 
between  Gauss  diffuse  and  cookie-cutter  damage  functions. 
An  analytical-numerical  solution  for  the  optimum  interval, 
T*,  is  available  for  the  von  Neumann-Gauss  function,  but 
none  is  for  the  cookie-cutter  or  the  trapezoidal  functions. 
If  the  latter  can  be  reasonably  matched  to  the  former,  an 
approximate  analytical  solution  is  available  for  these 
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latter  damage  functions.   Possible  matches  to  cookie-cutter 
are  these: 

co  R 

2  7 

1.  Mean  matching:    /   rexp(-ctr  )  dr  =  l/2a  =   /   rdr  =  R  /2 

0  0 

So,  the  Gauss  diffuse  damage  with  parameter  ct  and  cookie- 
cutter  with  radius  R  are  approximately  equivalent. 

2 

2.  Median  matching:   exp(-ar  )  =0.5  which  is  equivalent 

2 
to  a(R)  =  ln(2)/R  .   Thus,  this  transformation  matches  the 

medians  of  the  two  functions . 

It  is  not  possible  to  find  a  unique  best  transformation 

between  a  and  R  for  all  cases.   However,  one  can  test  a 

proposed  transformation  for  each  specific  case  by  simulation. 

2 
For  demonstration  purposes,  a (R)  =  ln(5/3)/R   is  a  proper 

transformation  for  R  =  14.29  on  condition  that  the  other 

variables  are  held  constant.   It  provides  the  same  optimum 

T  for  Gauss  diffuse  and  cookie-cutter  damage  functions  as 

is  seen  in  Appendix  E. 
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IV.   CONCLUSION 

The  purpose  of  this  thesis  has  been  to  show  that  mathe- 
matical models,  augmented  by  a  computer  simulation  program, 
can  provide  useful  ways  of  studying  the  impact  of  miscali- 
bration  upon  operational  effectiveness.   We  have  concen- 
trated here  on  specific  and  convenient  models,  but  it  is 
obvious  that  other  mathematical  models  can  be  treated 
similarly.   Other  analyses  similar  to  the  ones  we  have 
discussed  in  the  computer  program  can  be  conducted  pertaining 
to  the  other  alternatives.   The  relative  effectiveness  of 
different  system  configurations  can  also  be  investigated. 
The  results  of  the  simulation  can  then  be  analyzed  to  ascer- 
tain the  significance  of  different  factors  in  various  scenarios 

The  possibility  exists  that  operational  data  will  reveal 
different  underlying  distributions,  and  suggest  alternatives 
for  evaluating  effectiveness  other  than  the  ones  described 
in  this  thesis.   The  present  thesis  is  to  be  considered  a 
pilot  study  of  the  calibration  issue. 
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APPENDIX    A 
PLCTS    OF    TAG    VS.    GAflHA    AND    EFFECTIVENESS    VS.     TAD 
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APPENDIX    B 
PLOTS    OF    TAD   VS.    GAHHA    AND    EFFECTIVENESS    VS.     TAD     (BETA    =    1) 
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APPENDIX    C 
PLOTS    OF    TAU    AND    GAMMA    TRANSFORMATIONS 
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APPENDIX    D 
COHPDTER    SIMULATION    PROGRAM 
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APPENDIX  E 
PLOTS  OF  SIMULATION   RESULTS 
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